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Abstract.  This  paper  develops  a  reduced  block  successive  over¬ 
relaxation  method  for  solving  a  class  of  (large-scale)  linear 
complementarity  problems.  The  main  new  feature  of  the  method  is  that 
it  contains  certain  reduction  operations  at  each  iteration.  Such 
reductions  are  needed  in  order  to  ensure  the  boundedness  (and  therefore 
the  existence  of  accumulation  points)  of  the  sequence  of  Iterates 
produced  by  the  algorithm.  Convergence  of  the  method  is  established 
by  using  a  theorem  due  to  Zangwill. 
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ON  THE  CONVERGENCE  OF  A  BLOCK  SUCCESSIVE 
OVERRELAXATION  METHOD  FOR  A  CLASS  OF 
LINEAR  COMPLEMENTARITY  PROBLEMS 


R.U.  Cottle  and  J.S.  Pang 

1.  Introduction.  The  present  research  Is  motivated  by  an  investigation 
(still  in  progress)  of  methods  for  solving  a  certain  class  of 
"capacitated  quadratic  transportation  problems".  One  of  these  calls 
for  the  application  of  the  block  successive  overrelaxation  (BSOR) 
method  [4]  to  the  dual  of  the  given  problem.  However,  a  technical  problem 
Is  engendered  by  the  unboundedness  of  the  level  sets  of  the  dual  objective 
function  and  the  consequent  breakdown  of  the  convergence  proof  used  in  [4]. 
At  Issue  is  the  existence  of  an  accumulation  point  of  the  sequence  of 
iterates  produced  by  the  algorithm.  Fortunately,  the  structure  of  the 
problem  permits  a  modification  of  the  algorithm  that  leads  to  a  remedy  for 
this  complication.  Applying  a  simple  transformation  to  the  iterates  forces 
the  new  points  to  lie  In  a  compact  set.  Convergence  of  the  algorithm  can 
then  be  established  by  Invoking  a  theorem  of  Zangwill  [8]. 

Our  purpose  in  this  paper  is  to  establish  the  convergence  of  the 
modified  BSOR  for  a  class  of  problems  somewhat  larger  than  that  under 
consideration  in  the  aforementioned  study.  To  be  precise,  we  concentrate 
our  attention  on  a  (large-scale)  linear  complementarity  problem  of  the 

ij 

form:  Find  y,  v  €R  such  that 


The  following  blanket  assumptions  will  be  maintained  throughout 
this  paper: 

(A1 )  The  matrix  A  €  RP*P  Is  symmetric  and  positive  semi-definite; 

(A2)  there  exists  a  vector  x  such  that 

FAx  <  f;  (2) 

(A3)  there  exists  an  index  set  a  such  that  for  any  y  satisfying 

AF'y  «  0 

f'y  *  0  (3) 

0  *  y  >  0 

it  follows  that  y^  >  0  if  and  only  If  j  €<*. 

Remarks.  (A3)  holds  vacuously  if  (3)  has  no  solution.  In  fact,  the 
nonexistence  of  a  solution  to  (3)  is  equivalent  to  the  so-called  Slater 
condition,  l.e.  the  consistency  of  the  linear  Inequality  system  FAx  <  f. 

If  (A3)  holds  nonvacuously,  the  index  set  a  must  be  nonempty, 
though  its  cardinality  could  be  as  low  as  1  In  the  capacitated  quadratic 
transportation,  problem  mentioned  earlier,  (3)  does  have  a  solution. 

There,  the  Introduction  of  a  seemingly  mild  additional  hypothesis  on  the 
capacities  ensures  the  validity  of  (A3),  and  the  Index  set  a  is  easily 
Identified.  It  corresponds  to  the  supply  and  demand  constraints  of  the 
problem.  See  Section  6  for  further  discussion  of  this  application. 

Under  assumption  (Al),  the  linear  complementarity  problem  (1)  Is 
the  set  of  Karush-Kuhn-Tucker  conditions  for  the  convex  quadratic  program 


minimize  i»(y)  ■  (f  +  FAc)'y  +  Hy' FAF'y 
subject  to  y  >  0. 


(4) 


By  a  proof  like  that  of  Proposition  2.1  below,  (A1)  and  (A2) 

Imply  the  existence  of  a  solution  to  (1)  or,  equivalently,  (4). 

If  the  matrix  A  Is  In  fact  positive  definite,  then  (4)  Is 
essentially  the  dual  of  the  strictly  convex  quadratic  program 

minimize  *(x)  ■  c'x  +  %x'A*^x 
subject  to  Fx  <,  f. 

Note  that  (A2)  Implies  the  feasibility  of  (5)  and  thus  the 
existence  of  an  optimal  solution. 

In  proving  the  convergence  of  Iterative  procedures  for  nonlinear 
programming.  It  Is  customary  to  require  that  the  Iterates  lie  In  a 
compact  set.  The  set  In  question  Is  often  a  level  set  of  the  function 
being  minimized.  In  the  context  of  the  quadratic  program  (4),  the 
rolnlroand  Is  As  we  shall  show  later,  the  level  sets  of  <p  are  not 
bounded  if  the  system  (3)  is  consistent.  . 

In  the  present  paper,  we  shall  show  how  the  BSOR  method  described 
In  [4]  can  be  modified  In  such  a  way  that  the  possible  unboundedness  of 
level  sets  will  not  affect  the  convergence  of  the  method  for  solving 
(4)  -  or,  equivalently,  (1).  Our  analysis  provides  a  unified  treatment 
for  both  bounded  and  unbounded  level  sets.  In  particular,  the  analysis 
Includes,  as  a  special  case,  the  recent  study  of  Mangasarlan  [5]  Mho 
treats  the  quadratic  program  (5)  under  a  Slater  condition. 
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2.  Preliminary  discussion.  Throughout  the  paper  we  denote  the  linear 
complementarity  problem  (LCP) 

w  *  q  +  Mz  >  0,  z  >,  0,  w'z  »  0 

by  the  pair  (q,M).  For  a  given  H,  let  <(H)  be  the  set  of  all  vectors  q 
for  which  (q,M)  has  a  solution.  We  recall  that  If  h  Is  positive  seml- 
definite,  then  q  S  K(M)  If  and  only  if  the  Inequalities 

q  t  Mz  >  0,  z  >  0 
are  consistent.  (See  [1].) 

In  the  next  three  results,  we  present  some  properties  of  the  LCP  (1). 

Proposition  2.1.  For  all  vectors  a,  the  linear  complementarity 
problem 

(f  +  FAa,  FAF’)  (6) 

has  a  solution. 

Proof.  As  FAF'  is  (symmetric  and)  positive  semi -definite,  only 
consistency  need  be  verified.  If  the  LCP  (f  +  FAa,  FAF’)  Is  Inconsistent, 
there  must  exist  a  vector  u  such  that 

u'(f  +  FAa)  <  0,  u'FAF*  <  0,  u  >  0. 

In  the  presence  of  (Al),  the  latter  implies 

u'f  <  0,  u' FA  -  0,  u  >  0.  (7) 

But  (A2)  Implies  the  existence  of  a  vector  x  such  that  (2)  holds. 

Clearly  (2)  and  (7)  cannot  both  hold  simultaneously,  so  (6)  must  be 
consistent.  □ 
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The  theorem  below  characterizes  the  boundedness  (and,  consequently, 
the  compactness)  of  the  level  sets  of  certain  convex  quadratic  functions 
<l>  of  Interest  In  the  present  study.  Part  of  Its  proof  relies  on  a  much 
more  general  result  of  Rockafellar. 

Theorem  2.1.  Suppose  (A!)  and  (A2)  are  satisfied.  For  any  a,  the 
following  statements  are  equivalent  for  the  quadratic  function 
*(y):  «.(f  ♦  FAa)'y  +  Jjy'FAF'y. 

(1°)  For  each  X6  R,  the  set 

Y(X):  *  {y  i  0:  d»(y)  <,  X) 

Is  compact; 

(2°)  f  +  FAa  € Int  K(FAF'); 

(3°)  there  exists  no  vector  y  such  that 

AF'y  ■  0,  f'y  *  0,  0  *  y  >  0; 

(4°)  there  exists  a  vector  x  such  that 

FAx  <  f; 

(5°)  the  LCP  (f  +  FAa,  FAF')  has  a  bounded  solution  set. 

Proof.  Define 


’♦(y) 

if  y  >  0 

+GO 

otherwise 

Then  (1°)  holds  If  and  only  If  the  level  sets  of  f  are  bounded.  By 
[7.  Corollary  14.2.2],  this  Is  so  If  and  only  if  0  €  int  dom  f* 
where  v*  denotes  the  convex  conjugate  of  f.  Now  for  any  y*  we  have 


v*(y*)  =  sup  (y'y*  -  f(y)  :  y  arbitrary) 

*  sup  (y'y*  -  <|i(y)  :  y  >  0} 

*  -inf  {y1  (q  -  y*)  +  Jjy'Hy  :  y  >  0} 

igy'My  if  y  solves  (q-y*,M) 

*  . 

*  if  (q-y*,M)  has  no  solution 


where  q  =  f  +  FAa  and  H  *  FAF' .  It  therefore  follows  that 
dom  V*  ■  {y*  :  q  -  y*  6  K(M) } 

From  this  it  is  apparent  that  0  e  int  dom  **  if  and  only  if  q  6 int  K(M). 
Thus  (1°)  is  equivalent  to  (2°).  It  is  known  from  [2]  that  (2°)  is 
equivalent  to  the  condition  that  q  e  K(M)  and  the  only  solution  of  the 
system 

u'q  3  0,  u'M  =0,  u  >  0 

is  the  zero  vector.  By  Proposition  2.1,  q  ec(M)  is  implied  by  (Al) 
and  (A2)  which  are  in  force  here.  By  the  definitions  of  q  and  M  and 
the  assumed  properties  of  A,  (  9 )  becomes 

u'f  3  0,  u' FA  3  0,  u  >  0. 

Hence  the  equivalence  of  (2°)  and  (3°)  follows.  Combined  with  (Al ) 
and  (A2),  condition  (3°)  is  equivalent  to  the  fact  that 

u'f  <  0,  u’FA  3  0,  u  >  0 

has  only  the  zero  solution.  By  an  alternative  theorem,  this  is 
equivalent  to  (4®).  The  equivalence  of  (4°)  and  (5°)  is  a  direct 
consequence  of  [2,  Theorem  3.1].  □ 


Theorem  2.1  has  much  In  common  with  some  characterizations 
obtained  by  Mangasarian  [6].  Our  work  along  these  lines  was  done 


Independently,  however. 

Theorem  2.1  Implies  among  other  things  that  If  the  system  In 
(3°)  has  a  non-zero  solution,  then  the  level  sets  of  the  function  4 
are  unbounded.  In  fact,  the  following  stronger  result  obviously  holds. 
Proposition  2.2.  Let  y*  be  any  solution  of  the  system 

AF'y  *  0,  f'y  3  0. 


*(y  +  ey*)  *  *(y) 


for  all  y  and  e.  □ 


To  describe  the  BSOR  method,  we  let  the  rows  of  the  matrix  F  be 
partitioned  Into  blocks  F.  (i  *  l,...,m).  This  induces  a  partitioning 
of  H  *  FAF'  into  submatrices  3  F^AFj ' .  Let  the  vector  f  be 

partitioned  accordingly.  Let  denote  the  set  of  indices  of  the  rows 

in  F.j  (and  f^).  Let  n^  denote  the  cardinality  of  J^,  and  finally 


(referring  to  (A3))  let 


3  aHJ, 


i  3  1 ,. . .m. 


Obviously,  the  following  implication  holds: 


AF, ,yi  -  0 


^i'^l  *  0  )  ”*■  (y^)j  >  0  if  and  only  if  j 

0  *  yi  >  0  J 
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Once  the  partitioning  above  is  introduced,  then  for  i  * 

Proposition  2.1,  Theorem  2.1,  and  Proposition  2.2  apply  to  the  sub¬ 
problems  (f.  +  F^Aa,  F^AF^')  and  quadratic  functions 

♦tty)  3  (fj  +  F.Aa)'yi  +  ’ FiAFi  *yi  • 

In  particular,  as  we  shall  show  (Proposition  2.4),  assumption  (A')  implies 

that  at  most  one  of  these  subproblems  can  have  an  unbounded  solution  set. 

Before  proving  this,  we  give  a  geometrical  interpretation  of  the  assumption. 

Let  C  denote  the  set  of  all  vectors  y  satisfying  the  system  (3)  and  also 

containing  the  zero  vector.  The  next  result  shows  that  assumption  (A3) 

holds  if  and  only  if  the  set  C  is  a  ray  emerging  from  the  origin. 

Proposition  2.3.  Assumption  (A3)  holds  if  and  only  if  there  exists  a  non- 
* 

negative  vector  y  such  that 

★ 

C  =  {y  :  y  =  Xy  for  some  x  >  0}  . 

Proof.  Suppose  C  is  of  this  form.  If  the  system  (3)  is  inconsistent , 
there  is  nothing  to  prove,  so  suppose  it  is  consistent.  This  implies 

it 

that  the  vector  y  must  be  nonzero.  Let  a  be  the  set  of  indices  which 

★ 

correspond  to  the  nonzero  components  of  y  (i.e.,  its  support).  Obviously, 
if  y  e  C  \  {0},  then  y^  >  0  if  and  only  if  j  6  a. 

Conversely,  suppose  that  assumption  (A3)  holds.  If  (3)  is  inconsistent 

*  /  \ 
it  suffices  to  let  y  be  the  zero  vector.  On  the  other  hand,  if  (3)  is 

* 

consistent,  let  y  be  any  one  of  its  solutions.  Let  y  €  C  \  {0}.  Con- 

it  it 

sid er  the  vector  y  -  xy  .  For  suitable  x  >  0,  the  vector  y  -  xy  will  be¬ 
long  to  C  and  have  at  least  one  zero  component,  say  the  j-th  one  with  j  €  a. 

* 

By  (A3)  this  is  impossible  unless  y  -  xy  is  the  zero  vector.  This  proves 
the  proposition.  □ 
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Proposition  2.4.  Let  assumption  (A3)  hold.  Then  for  any  partitioning  of 
the  rows  of  F,  there  can  exist  at  most  one  index  i  for  which  the  system 


Yyi a  °»  V*i  a  °»  0  *  *i  i'° 


is  consistent. 


Proof.  Indeed,  if  there  are  indices  i,  #  i„  for  which  (11)..  and  (11 L 

1  L  ’l  h 

*  * 

are  consistent,  let  y,  and  y.  be  solutions  of  these  systems,  respec- 

11  2  2 

tively.  Obviously,  the  vectors  y  *  (yt)  and  y  =  (y£)  with 


0  if  i  f  i-. 

»;  -< . 

*  Vi, 


2  I0 

y‘  V*2 


satisfy  the  system  (3).  By  (A3),  we  must  have  a  C  J.  n  j.  =0.  This 

’l  h 

contradiction  establishes  the  proposition.  □ 


ft 


] 


3.  Closedness  of  the  component  maps.  The  main  tool  used  in  our  convergence 
result  for- -the  modified  3S0R  mettiocf  isTbnvergence*ThefiPem"A‘  fi?  ZahgwTl  1  '* 
[8].  To  apply  the  theorem,  it  is  necessary  to  show  that  the  “algorithmic 
map"  involved  is  closed.  In  this  section,  we  establish  some  preliminary 
results  useful  for  this  purpose. 

The  total  number  of  rows  in  the  matrix  F  is  N  *  n^.  For  each 

*  ni 

i  a  l,...,m  let  yj  €  R  be  either  a  fixed  vector  satisfying 

the  system  ( 11 ) ^  if  the  system  is  consistent  or  the  zero  vector  it  if  is 

*  *  *  * 
inconsistent.  Let  y  *  (y-j ....  *ym)  •  Then  obviously,  y  is  either  0  or 

it  satisfies  the  system  (3). 

ni 

A  vector  yi  €  R+  is  said  to  be  reduced  (with  respect  to  the  index 
set  a.-)  if  at  least  one  component  in  the  subvector  (y,.)  is  equal  to 

1  1  Qlj 

•it 

zero.  Then  by  (11)^,  y^  is  either  zero  or  not  reduced.  Let  denote 

ni 

the  set  of  all  reduced  vectors  in  R+  .  The  i-th  reduction  map 
ni 

R.j  :  R+  -*■  5^  is  defined  as  follows: 

Ri(yi>  =  yi  "  piy* 

where 

fmin  Uy^)j/(yJ)j  :  J  e  if  yj  /  0 
0  otherwise 

* 

The  reduction  map  R^  is  well  defined  and  continuous.  If  y^  =  0, 

then  a.j  is  just  the  identity  map.  Similarly,  by  dropping  the  sub- 

N 

script  i,  we  may  define  the  reduced  vectors  in  R+  as  well  as  the 

N 

complete  reduction  map  R:  R+  -*•  S,  where  S  is  the  set  of  all  reduced 
N 

vectors  in  R+. 


-  10  - 


Me  define  the  i-th  complementarity  wap  -►  R^}  x  as 

follows .  Given  y  *  (y-,,...,y_)  €  r|)*,  <\(y)  denotes  the  set  of  all 
points  (y,  where  y^  solves  the  LCP  (f^  +  F^Aa,  F^AF^ ')  where 


a  *  c 


In  general,  is  a  point-to-set  map.  By  Proposition  2.1,  C.(y)  is 
nonempty  for  each  i. 

Note  that  if  the  subproblem  has  a  unique  solution,  then  by 

Theorem  2.1,  Rj(y^)  *  y^  so  that  the  i-th  reduction  is  unnecessary. 

Roughly  speaking,  the  motivation  for  including  the  reduction  step  in 

defining  the  map  is  to  ensure  that  maps  bounded  sets  into 

bounded  sets. 

★ 

Let  gd  <  2  be  a  given  positive  scalar.  Define  the  i-th 
relaxation  map  :  R^  x  R+^  -*  R^  as  follows.  For  (y.y^)  6rJx  R+* 

the  set  Pj(y,y.j)  consists  of  all  vectors  of  the  form 

(yl,',*»yi-l’yi,yi+l . ym^ 

where  y^  *  y^  +  &>(y.j  -  y^)  for  some  u  such  that 

★  **  ★  - 
min  {u  |1}  <  ii  <  «  and  y^  £  0. 

The  relaxation  step  in  [4]  is  a  particular  realization  of  the  relaxa¬ 
tion  map  where  u  is  chosen  as  the  largest  possible  value  of  &>  for  which 

u  £  id  and  y,j  +  u(y^  -  y.)  >  0. 

A  point  to  set  map  M  :  U  -*■  V  is  bounded  if  for  every  subset  TCI), 
the  image  U{M(t)  :  t  e  T)  is  a  bounded  subset  of  V. 


Let  8.J  *  Pj  °  C.j  denote  the  composition  of  the  i-th  complemen¬ 
tarity  and  relaxation  maps.  In  what  follows,  we  show  that  8^  is  a 
closed  and  bounded  map  from  into  itself.  We  first  prove  this  for 

C1* 

For  each  index  i  and  vector  a  €  Rp  let  X.j(a)  denote  the  set  of 
all  solutions  of  the  LCP  (f^  +  FAa,  F^AF^'). 

Lemma  3.1.  (X^ (a) )  »  {y^  €  X^a)  :  TT  (y^)j  *  0}  . 

j^i 

Proof.  For  brevity,  let  T.  be  the  set  on  the  right.  Since  Pj(y^)  *  0 
for  each  yi  €  T\,  it  follows  that  T..  C  R-U^a)).  Conversely,  let 

y.  3  My*)  where  6  x*(a).  Then  obviously,  TT  (yJ<  *  o. 

1  1  1  11  jSxj  1  J 

It  can  easily  be  shown  that  y^  also  solves  the  LCP 
(^  +  FAa,  FiAFi‘).  □ 

Proposition  3.1.  The  i-th  complementarity  map  is  both  closed  and 
bounded. 

Proof.  To  show  that  is  closed,  let 

yk  ■*  y,  yk  e  rJ 

zk  -+z  •  (y,yi ) ,  zk  ■  (yk,  ^(y^))  e  qCy1*)- 

A  aL  ^ ^ 

As  y^  Is  the  limit  of  a  sequence  of  reduced  vectors  y^  *  R^(y^),  It  Is 

A 

itself  reduced.  It  therefore  suffices  to  prove  that  y^  €  X^(a)  where 
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•  *• 


a  *  e  +  7  F.'y..  Lemma  3.1  Implies  that  for  each  k 
til  J  J 

>  0,  vj  *  ^  +  F^Aak  +  F.AF^yJ  >  0,  (^),(yk)  -  0 

k  _  i/ 

where  a  3  c  +  >  Fiy„.  Passing  to  the  limit  as  k  — >  •,  we  obtain 

vti  1  1 

i  0.  +  F^Aa  +  F1AF1'yi  >  0,  (v^ ) ' (y^ )  3  0. 

This  establishes  the  closedness  of  C^.  It  is  also  bounded,  for  suppose  the 
contrary.  Then  there  exists  a  bounded  subset  T  C  such  that 

utC^t)  :  t€T}  is  unbounded.  Hence  there  exists  sequences 

<yk}€T  and  {zk>  •  {{yk,  ^(yjf)}  with  zkeci(yk)  such  that  lzkl  — >  »  . 

k  kv 

Since  {y  }  is  bounded,  it  has  a  convergent  subsequence  {y  }  tending  to 

some  vector  y  €  r)JJ.  Let  yk  a  R^(y^).  Since  lzkl  — >  >»  and  (ykJ  is 

bounded,  we  must  have  ly*l  — >  »  .  However,  the  normalized  sequence 
^k  _k 

Ly1 v/lyiwl}  has  a  limit  point,  y^ ,  and  clearly  y.  is  reduced.  Without 
loss  of  generality,  we  may  assume  yjV/lyjVl  — >  y.j-  For  each  k^  we 
have  by  Lemma  3.1 

(y/VCf,  +  F^a^  +  F^F.'y/)  «  0 

k  k  »kv,2 

where  a  v  ■  c  +  T  F  'y.v.  Dividing  the  above  equation  by  ly,  *  and 

£#i  1  1 

passing  to  the  limit  we  obtain 

a  0  • 
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By  (Al)  it  followsjthat  _  ^  . v_  _  _  ^ 

*V*i  *  0  .  (12) 

Furthermore,  we  have 

0  >(yi  ),[fi  +  F^Aa  ) 

„k 

Dividing  by  *y1 VI  and  passing  to  the  limit  as  k — »  «  ,  we  obtain 
(in  view  of  (12)) 

(yf  )'fj  <o  . 

By  Proposition  2.1,  we  conclude  that  yi  satisfies 

iO,  (/,)•/,  -0.  0. 

Consequently,  It  follows  that  (y.)  >  0  .  But  this  contradicts  the 

I 

fact  that  y^  is  reduced.  □ 

Proposition  3.2.  The  i-th  relaxation  map  P^  is  both  closed  and 
bounded. 

Proof.  The  boundedness  is  obvious.  To  show  that  P ^  Is  closed, 
let  (yk,yk)  — >  (y,^)  and  zk  — >z  where 

Zk  •  . yk)  ep^y* 

and 

2  ■  (y1..*-»yi.1»y1.yi+1,...,y|n)  . 


It  suffices  to  show' that  there  exists  -a -seal  at  w  with  min{u*,l}  £  w  <. 
such  that  y^  *  +  u(y^  -  y^).  But  for  each  k,  there  exists  a  scalar 

wk  €  [min{u*,l  },u*]  such  that  y*  *  y*  +  «k(y|[  ■  yj)  >  0  .  Since  the 

uk  lie  in  a  compact  interval  they  have  a  limit  point  w.  This  w  will 
do.  □ 

Lemma  3.2.  The  composition  of  two  bounded  (point- to-set)  maps  is 
bounded. 

Proof.  Indeed,  if  :  U  — >V  and  :  V  — »W  are  two  bounded  (point- 
to-set)  maps  and  T  is  a  bounded  subset  of  U,  then  the  set 
M2oM1  (T)  =  U{M2(s)  :  s  GM^T)} 

is  obviously  bounded.  □ 

Combining  these  results,  we  obtain  immediately 
Proposition  3.3.  The  map  8^  is  both  closed  and  bounded. 

Proof.  This  follows  from  Propositions  3.1  and  3.2  by  applying 
Lemma  3.2  and  [8,  Lemma  4.2].  □ 

Remark.  The  boundedness  of  the  complementarity  map  is  crucial 

in  order  to  apply  Lemma  4.2  in  [8]  to  deduce  that  is  closed.  For 
the  same  reason,  the  boundedness  of  8^  is  important  in  proving  the 
closedness  of  the  algorithmic  map  to  be  given  later.  The  role  played 
by  the  reduction  maps  in  these  deductions  should  now  be  very 
transparent. 

We  point  out  that  a  vector  r  G  8^(y)  might  not  be  reduced  with 
respect  to  a^.  This  is  because  the  relaxation  map  Pj  does  not  necessarily 
preserve  "reducedness". 
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4.  The  Reduced  BSOR  Algorithm.  In  its  simplest  form,  the  modified 
version  of  the  BSOR  method  for  solving  the  LCP  (1)  can  be  described 
by  its  associated  algorithmic  map 

A  »  R  0  8m  ®  ...  «  B1  (13) 

More  precisely,  given  an  arbitrary  non-negative  vector  y®,  the 

-k 

algorithm  generates  a  sequence  {y  >  of  vectors  as  follows.  If  y 

*k+l  k 

solves  the  problem  (1),  stop;  Otherwise  pick  a  vector  y  €  A(y ) 
and  repeat.  For  an  obvious  reason,  we  call  this  the  Reduced  BSOR 
Algorithm.  It  is  clear  that  any  fixed  point  of  the  map  A  solves  the 
LCP  (1). 

There  are  essentially  two  new  features  in  this  Reduced  BSOR 
Algorithm.  First,  a  (possibly  unnecessary)  reduction  is  performed 
after  each  linear  complementarity  subproblem  is  solved.  (The  precise 
manner  in  which  these  subproblems  are  solved  is  optional.)  Second, 
at  the  end  of  each  iteration,  a  complete  reduction  (defined  by  the 
map  R)  is  performed.  We  have  seen  how  reductions  of  the  first  kind 
are  useful.  Basically,  the  second  kind  of  reduction  is  needed  for 
a  similar  reason;  namely,  to  ensure  the  boundedness  of  the  sequence 
(y  }  generated  by  the  algorithm. 

Our  principal  convergence  result  for  the  Reduced  BSOR  Algorithm 
Is 

Theorem  4.1  Applied  to  the  LCP  (1)  for  which  (Al),  (A2)  and  (A3) 
are  satisfied,  the  Reduced  BSOR  Algorithm  either  terminates  with  a 
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solution  or  else  the  sequence  of  Iterates  contains  an  accumulation 
point  which  solves  the  problem. 

We  first  establish  three  preliminary  results.  The  first  one 
extends  Theorem  1  in  [4]. 

Lemma  4.1  Let 


where  M^,  *  M21 '  *  M22*  r*  and  s  are  9*ven»  Mn  is  symmetric  and 

positive  semi-definite,  and  x1 ,  x2  are  vector  variables. 

Let  i1  solve  the  LCP  (r  +  M^x-,  M.j)  for  some  vector  x2.  Then  for 
all  x1  >  0  and  all  u  €  (0,2) 

*(x1  +  ««(xj  -  x^.Xg)  <  ♦(x1  ,x2) 

with  equality  if  and  only  if  x^  also  solves  the  LCP  (r  +  M12x2,  M^). 
Proof .  Let  5  *  (4»(x1  +  01(3^  -  x^,  x2)  -  ♦(x^  ,x2))/u>. 

By  the  proof  of  Theorem  1  In  [4],  we  have 

«■(*,-  x^'fr  +  M]2x2)  +  -  x1)'M11x1  +  -  x1)'M11(x1  -  x^ 

^(X|  -  X-j )  (r  +  M^2x2)  +  (x^  -  x-j ) '  M-j  -j  +  (x-j  -  xi )  'Mii  (x-j  -  x^ ) 

*  x-|'(r  +  M^x^  +  M12x2)  -  x-j’tr  +  M^x-j  +  M12x2)  <,  0  . 

If  6  -  0,  then 

(x,  -  x, )'M, , (x,  -  x,)  ■  x,'(r  ♦  M,,x,  +  M.JL)  -  0 


fSs*Sb*. 


Since  is  symmetric  and  positive  semi-definite,  M^x^  3  and 

hence,  x-j  solves  the  linear  complementarity  problem  (r  +  Mi 2*2 *  Mll^ 
as  well.  □ 

U 

Corollary  4.1.  For  any  y  €  R^  and  z  €A(y), 

*(2)  <  4>(y) 

with  equality  if  and  only  if  y  solves  (1). 

Proof.  This  follows  easily  from  the  definition  of  A  and  repeated  use 
of  Proposition  2.2  and  Lemmas  3.1  and  4.1.  □ 

*-k 

Lemma  4.2.  The  sequence  (y  }  of  iterates  generated  by  the  Reduced 
BSOR  algorithm  is  bounded. 

Proof.  By  Corollary  4.1,  we  have  for  each  k 

<Kyk)  ^  x  *  <Ky°) 

The  remainder  of  the  proof  resembles  that  of  Proposition  4.1  and  is 
omitted.  □ 

Proof  of  Theorem  4.1.  By  repeated  use  of  Proposition  3.3  and 
[8,  Lemma  4.2]  one  can  easily  show  that  the  algorithmic  map  is  closed. 
The  desired  conclusion  now  follows  from  Lemma  4.2,  Corollary  4.1  and 
Convergence  Theorem  A  in  [8], 
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5.  An  extension.  It  Is  rather  easy  to  extend  the  reduced  BSOR  algorithm 
to  treat  the  following  generalization  of  the  quadratic  program  (4): 

M  *  »  •  -  .  # 

Find  a  vector  y  6  R  to 

minimize  $(y)  *  q'y  +  Jjy'My  subject  to  y^  €  Yj  i  *  l,...,m.  (14) 

ni 

Here  the  vector  y  is  partitioned  into  subvectors  y^  6  R  and  each 


n 


is  a  nonempty  polyhedral  set  in  R 

n 


i. 


Y1  -  (y^  e  R  1  :  B1y<  <,  bi  and  Ejyi  «=  f^} 

where  and  are  arbitrary  matrices  and  b^  and  f^  are  arbitrary  vectors. 
The  matrix  M  in  (14)  is  symmetric  and  positive  semi -def i ni te  and  is  parti¬ 
tioned  into  submatrices  My  (i,j  *  l,...,m)  where  each  is  n^  by  n^. 

The  vector  q  is  partitioned  accordingly. 

Without  repeating  many  of  the  details,  we  shall  in  what  follows  sim¬ 
ply  present  the  generalized  version  of  (A3),  define  the  component  maps 
and  state  the  main  theorem  of  convergence  for  the  algorithm.  We  point 
out  that  the  program  (14)  includes  as  a  special  case  the  one  treated  in 
[3].  In  the  latter  program,  each  Yj  is  a  closed  interval  of  R  and  the 
matrix  M  is  symmetric  and  positive  definite. 

For  i  *  l,...,m,  let  denote  the  set  of  indi.ces  in  the  subvector 
y^  and  let  0+Y^  denote  the  recession  cone  [7]  of  the  set  Y. ,  i.e., 

+  ni 

0  Y1  -  {d1  €  R  1  :  B1di  <  0  and  E1-di  *  0}  . 


Define 


and  let 


C1  «  (d1  €  R  1  ;  q1'di  -  0,  -  0}  O  0+Y1 


C  *  (d  S  RN  :  q’d  -  0,  Md  »  0}  n  0+Yr 
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Let  B  denote  the  block  diagonal  matrix  whose  diagonal  blocks  are  the  B^. 
m 

Finally,  let  Y  *  '[“j'  Yj  be  the  feasible  set  of  the  program  (14).  We 

state  the  generalized  version  of  the  assumption  (A3): 

(A4)  There  exists  a  nonempty  index  set  a  such  that  for  any  vector 
d  €  C  \  {0}  ,  it  follows  that  (BdL  <  0  if  and  only  if  j  6  «. 

J 

★ 

For  each  i  *  l,...,m,  let  0l-  *  a  ft  Let  d^  be  a  vector  in 
C1  \  {0}  if  Ci  t  {0}  or  the  zero  vector  if  Cj  3  {0}.  Let  d*  *  (d^,...  d^). 

A  vector  y^  6  Y^  is  said  to  be  reduced  (with  respect  to  the  index 
set  a.j )  if  at  least  one  component  in  the  subvector  (b^  -  B^y^  Is  zero. 

Let  denote  the  set  of  reduced  vectors  in  Y^ .  The  reduction  map 
r^:Y.  -*■  Sj  is  defined  as  follows: 

Ri(yi )  ■  y,  - 


where 

p1  *  Pi(yi) 


{(Biyi  -  b^ ) j/ ^ ® i ^i ) j  •  J  ^ 


if  d*  t  0 
otherwise. 


Similarly,  by  dropping  the  subscript  i,  we  may  define  reduced  vectors  in 
Y  and  the  complete  reduction  map  R:Y  -*■  S,  where  S  is  the  set  of  reduced 
vectors  in  Y. 

Extending  the  i-th  complementarity  map,  we  define  the  i-th  sub¬ 
program  map  :  Y  -»  Y  x  .  Given  y  *  (y-j , . . .  ,ym)  €  Y,  S^(y)  denotes 
the  set  of  all  points  (y,  R^(y))  where  y^  solves  the  quadratic  program 


minimize  (q^  +  \  M^yjJ'z.j 
jri 


*i’Mii; 


subject  to  z^  e  y^.  (15) ^ 


It  is  important  to  note  that  the  set  Y^  is  included  as  the  feasible 
region  of  the  i-th  subprogram. 


Finally,  the  i-th  relaxation  map  P^:Y  *  -*•  Y  is  defined  as  follows. 

*  _ 

Letu  <2  be  a  given  positive  scalar.  For  (y,y^)  £  Y  x  Y<t  the  set 

Pj(y»7f)  consists  of  all  vectors  of  the  form 

(*1  *  *  *  •  »yi-l  ,yi  *yi+l  *  *  ■  *  *ym^ 

*  **  _  -  it  -  it 

where  y|  *  y.  +  w(y.j  -  y^)  for  some  w  such  that  min  (w  .1)  £  «  <  u  and 

yi€  V 

Let  8^  =P^°Sj  be  the  i-th  component  map.  The  algorithmic  map  A  is 

defined  by  (13).  The  main  convergence  theorem  is  the  following. 

Theorem  5.1 .  Suppose  that  the  quadratic  program  (14)  has  an  optimal 

solution  and  that  assumption  (A4)  holds.  Then,  provided  that 

»  0 

the  initial  vector  y  Is  feasible,  the  same  conclusion  of  Theorem  4.1  holds 
for  the  reduced  BSOR  algorithm  applied  to  the  program  (14). 

Remark .  The  assumption  that  the  program  (14)  has  an  optimal  solution  is 
not  crucial  for  the  applicability  of  the  algortihm.  In  fact,  without  the 
assumption,  the  algorithm  can  still  be  applied  but  may  terminate  at  a 
situation  where  a  certain  subprogram  (15)^  has  an  unbounded  objective 
function  value.  It  is  easy  to  show  that  if  this  happens,  then  the  ori¬ 
ginal  program  (14)  must  have  an  unbounded  objective  as  well. 


6.  Concluding  Remarks.  This  paper  is  intended  to  provide  the 
theoretical  foundations  for  the  Reduced  BSOR  method  which  is  one  of 
the  algorithms  being  considered  in  our  investigation  of  computational 
procedures  for  solving  the  capacitated  quadratic  transportation  problem. 
One  of  the  possible  formulations  of  the  latter  problem  leads  to  a 
natural  partitioning  (of  F)  with  m  *  4.  it  also  has  the  property 
that  A  is  positive  definite  and  diagonal. 

Preliminary  computational  experience  with  problems  of  considerable 
size  (e.g.  N  £  5000)  suggests  that  the  Reduced  BSOR  method  may  prove 
efficient  In  this  application  and  possibly  others  as  well.  We  plan  to 
report  on  our  computational  results  elsewhere. 
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